new matter. Therefore, entry of the Substitute Specification is respectfully 
requested. 

The claims have been amended to improve their form for examination and to 
eliminate multiple dependencies. 

The abstract has been amended to provide an abstract in proper format. 

Entry of the preliminary amendment and examination of the application is 
respectfully requested. 

To the extent necessary, applicant's petition for an extension of time under 37 
CFR 1.136. Please charge any shortage in the fees due in connection with the filing 
of this paper, including extension of time fees, to Deposit Account No. 01-2135 
(612.40914X00 ) and please credit any excess fees to such deposit account. 
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FIELD OF THE INVENTION 



The^ject of thej present inventionj^ a method for forming a neural network 
module£intended^for real-time simulation of the flow mode, at any point of a pipe, of a 
multiphase fluid stream comprising at least a liquid phase and at least a gas phase, that 
is best suited to operating conditions and to a set of fixed physical quantities. 



BACKGROUND OF THE INVENTION---- 

Transporting hydrocarbons fi-om productioiHsites to treating plants constitutes an 
important link in the petroleum chain. It is a delicate link because of the complex 
interactions between the phases forming the transported effluents. The basic objective 
for operators is to reach an optimum productivity under the best safety conditions. They 
therefore have to control as best they can the velocity and the temperature so as to avoid 
unnecessary pressure drops, unwanted deposits and unsteady-state flows. The method 
that is generally used consists in modelling in the best possible way the transportation of 
con^lex multiphase streams so as to provide at all times an image of the flows in the 
various parts of the production chain, taking into account the precise constitution of the 
effluent, the flow rates, the pressures and the flow modes. 

There are currently various software modules for simulating the transport of 
complex multiphase streams, allowing to design suitable production equipments at an 
early stage. 

"Patents ^8^,550,761,^-2,756,044 (Us\6,028,99f)J and ^-2^^^ (US^ 
5,960,1 S'J^filed by the a^^SeS^notably describe modelling modules^^forai^g the 
TACITE model known to^e man skille^lin the art, allowing >($ Simula^ the transport 



of complex multiphase streams rar steady or transient flow and^apable of taking into! 
account (instability phenomena that occur because of the irregular geometry of the 
formation crossed by the pipe or of the topography thereof referred to by specialists as 
^<<Jterrain sluggin^>x or j< severe slugging|^>A. 

The simulation modules are as conq)lex as the modelled phenomena. Precision and 
performances can only be obtained after a relatively long modelling time, which is not 
really compatible with real-time management. That is the reason why these modelling 
modules cannot be used as they are for real-time management of the production. It 
therefore appears necessary to use modelling methods offering a good compromise 
between calculating speed and accuracy of results. 

1^ Patent appUcationy^R400/09,889 filed by the applioant describes a method^tended 
fo^^l-time estimation of the flow mode, at any point of a pipe having a structure that 
can be defined by a certain nimiber of structure parameters, of a multiphase fluid stream 
defined by several physical quantities and comprising liquid and gas phases. According 
to this method, the flow mode is modelled : 

- by forming a non-linear neural network with an input layer having as many inputs as 
there are structure parameters and physical quantities necessary for good estimation of 
the output, an output layer with as many outputs as there are quantities necessary for 
estimation of the flow mode, and at least one. intermediate layer, 

- by forming a learning base with predetermined tables connecting various values 
obtained for the output data to the corresponding values of the input data, and 

- by determining, by iterations, weighting factors of the activation fimction allowing 
^t^ prope^ connect the^alues in the input and output data tables. 
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Output data of the neviral network is preferably analy^d so as to sort, among the 
values of the output data of the neural network, only the pertinent data tp be taken into 
account for iterative determination of the weighting coefficients of the activation 
function. 

SUMMARY OF THE INVENTION 
The method according to the ini/ention^llows t^fom^ module (hydrodynamic or 



thermodynamic for example)Yntended fo^ real-time simulation of the flow mode, at any 
point of a pipe, of a multiphase fluid stream comprising at least a liquid phase and at 
least a gas phase, so that it is best suited to fixed operating conditions concerning a 
10 oortoin nmnber of determined structure and physical parameters relative to the pipe, and 
a set of determined physical quantities (hydrodynamic or thermodynamic quantities for 
example), with fixed variation ranges for the parameters and the physical quantities. 

Jlf comprises using a modelling system based on non-linear neural networks h£u4ag 

Wo 

eachj^inputs for structure parameters and physical quantities, outputs where quantities 
1 5 Qr3 necessary for estimation of the flow mode are available, and at least one intermediate 
layer. The neural networks are determined iteratively so as to adjust to the values of a 
learning base with predetermined tables connecting various values obtained for the 
output data to the corresponding values of the input data. 

The method^ character^dhi thaj|a learning base suited to the imposed operating 
20 conditions^s formedjand optimized neural networks best adjusted to the imposed 
operating conditions are generated. 
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In the case, for example, where the module is to be integrated in a general 
multiphase flow simulation model, both hydrodynamic and thermodynamic, the model 
is used to form the learning base so as to select the set of physical quantities that is best 
suited to the model, as well as the variation ranges fixed for ^sd parameters and said 
physical quantities, and the optimized neural networks that best adjust to the learning 
base formed are generated. ^^^^ OrScR.J>ti<^*s* Of= TH^ O^/bil*^ 

DETAILED DESCRIPTION 
of TcvJW|f^oT)4iO (1 

General points concerning the formation of the neural networks system 



A 



and at least a gas phas^and we try 



^•fesm a nbural system^Uowii^ from 



circulation of multiphase fluij^s in g^pipe ^ith at lea^ a liquid phase 

from a certain 

number of geometrical and physicalinpizt data relative to the pipe and of physical data 
relative to the fluids,^ give instantl^ for^ch section of the fluid stream, an estiitiation 
of the flow mode or, from a 6@$te» number of data linked with the pressure and 
temperature conditions of the fluid, and with the composition of the fluid, ^ givizfihe 
thermodynamic behavio^ of the fluid. The whole of this input data constitutes a 
database. 



n hiput and output data 



The input data is for example : 



- geometrical and physical data of the pipes : diameter, roughness and angle of 
inclination of the pipe, and thermodynamic data : density of the gas, density of the 
liquid, viscosity of the gas, viscosity of the liquid, etc. ; the whole of this data 



constitutes an n-uplet, and i a Ji 




- hydrodynamic data characterizing the mixture : gas/liquid surface tension, volume 
fraction of gas, barycentric velocity of the mixture, etc., 

or : 

- thermodynamic data relative to the environment of the fluid : pressure, temperature, 
the whole of this data constituting an n-uplet, as well as data characterizing the 
con:9)osition of the mixture : molar mass, critical properties, enthalpy coefficients, etc. 

The model produces for example at the output the hydrodynamic behavio^ of the 
effluents, and notably the flow regime. It evaluates and delivers at two main outputs 
hydrodynamic data in the part of the pipe where the flow type is to be determined, the 
velocity difference dV between gas and liquid for example, or the stratified type flow 
fraction p (p e [0 ;1]) (type where the liquid phase flows in the lower part of the pipe). 
Other quantities qualifying the flow type can be calculated from these two outputs. 

In applications to thermodynamics, the model produces at the output the 
thermodynamic quantities of the effluents such as, for example, the number and the 
nature of the phases in presence or the molar fractions of the phases. 

2^ Structure of the system of networks 

The function to be modelled by the hydrodynamic or thermodynamic model 
involves various subfunctions that can be solved by using, if necessary, several 
networks playing a well-determined part within the model For example, a network can 
be dedicated to the non-linear fimction regression, while another network is dedicated to 
the classification of the various flow regimes. Besides, the connections to be established 
between the networks or between the module and its outer environment can require 



con^)lementary data processing (data normalization, denonnalization, etc.). The system 
is therefore referred to as based on neural networks. 

In order to connect the udiole of the hydrodynamic or thermodynamic input and 
output data, a system of neural networks is formed, these networks being preferably of 
MLP type, well-known^ the man skille^in the art, since it is particularly well-suited 



for physical phenomena modelling. Its structure allows describj^ tl^e dynamic as well 



as the static components of the phenomena, even by fixing, if necessary, some of its 




parameters at a JCifiodV value, therefore physically representative. Thu5, knowing 
physical equations tlmt govern the flows allows for example td enrich the network and 
Jt6 best adap£-k to the physical phenomena modelled thereby. 

The neural network con^rises (Fig.l) three layers for example : the input layer 
£consistin^ of ten neurons corresponding to the ten data (mentioned above) of the 
complete physical model, an output layerj^onsisti^ of two neurons corresponding to 
the two parameters dV and p sought, and an intermediate layer, referred to as hidden 
layer, ^ose nuniber of neurons Nc is optimized. The network is totally connected. The 
non-linearity of this network is obtained by a sigmoid activation function governing the 
behavio^ of the neurons in the hidden layer. The neurons of the output layer can be 
selected linear or non-linear. The activation function can be the identity function for 
example. 

y\ Learning 

The weights of this structure are determined at the end of a learning stage ; during 
this stage, the network is supplied with a set of data forming the learning base of the 
network, and the structure and the weights of the network are optimized by minimizing 



the errors observed for all the samples of the base, between the output data resulting 
from network calculations and the data expected at the output, given by the base. The 
errors can be the absolute errors between the input and output quantities or the relative 
errors, according to the performance desired for the network. 

The generalization powers of the Mtwork are then tested from its capacity to 
properly calculate the two outputs for inputs that are unknown thereto. 

Implementation particularities 

The system based on neural networks modelling the hydrodynamic module or the 
thermodynamic module is defined by a set of parameters that the learning base allows^ 
determine andjo fix. These parameters are adaptable to the constraints imposed by the 
use to which this module is dedicated. 

If the module is intended for me lira general context, the learning base hisedi has to 
be exhaustive, i.e. include all the available data concerning the various inputs/outputs ; 
the module can thus represent all of the cases that can be encountered in the field. 

If the module is/mtended foij use in a more specialized framework or context, 
production of an oil field for exanq>le, adjustment is carried out on a more restricted 
learning base containing only the data that can be encountered in this field alone : type 
or structure of the pipes or pipelines, topographic variations, more restricted ranges of 
variation of certain hydrodynamic or thermodynamic quantities, etc. The parameters of 
the neural networks are in this case calculated so as to obtain a product specific to a 
given configuration, in order to represent in the best possible way the flows in operating 
ranges specific to this field. 
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This module is thus adaptable to the various ^jectives fixing th^use thereof. 
Environment of the neural network module 

The module developed can be used alone, without associated modules. In this case, ^ 
yif is adjusted to databases formed according to the desired use, according to whether the 

or thermodynamic quantities likely te mow monitoring of the behaviojir of effluent 
flows in pipelines, from a learning base containing physical and thermodynamic 
quantities data provided otherwise. 

The module can also be implemented in any model (set of simulation software 
modules capable of simulating the transient and/or steady behavio|r of multiphase 
flows, such as for example the TACITE model mentioned above). In this case, the 
module is adjusted to reference models representing the current state of the art, and to 
associated databases that widely cover the whole of the definition domain of the n-uplet 
formed by the input data. This adjustment thus takes into account the specificities of the 
software environment in which it is included. 

To form the learning base that is best suited to the model where the neural system is 
to be integrated, the model is advantageously used to connect the input and output data. 

Examples of use 

The module based on nexiral networks is suited for any application requiring 
hydrodynamic representation of efiQuents : formation of flow predictive simulation 
codes, real-time simulation or training simulation, etc. Active production control 
methods can also be based on such a module. 
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Optimization examples 

Consider for example the case where a network giving the classification of the fiow 
type of multiphase fluids is to be optimized : stratified type or class CI flow (defined 
above), intermittent type or class C2 fiow (characterized by a succession of liquid and 
5 gaseous slugs), or dispersed type or class C3 flow (the Uquid being carried along in 
form of fine droplets), according to inputs as described^ piaragraph <aGeneral*points 

o f t» 'r ^ J 

^nceming theyformation of the/ietwork>f. 

Q A neural network is first formed by means of a general base. The resulting optimimi 

ry structure obtained contains 30 neurons, with a single hidden layer. The network 

j 10 confusion table obtained (Fig.2) expresses the classification percentage obtained in the 
three output classes of the network for each class of the database. 
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The database used is then restricted to^n^particular configurations, which reduce 
the ranges of variation of the various inputs of the network. The optimum neural 
network consists in this case of 28 neurons and con^rises a single hidden layer. The 
15 classification result is shown by the confiision table in Fig.3. 

It can immediately be seen that the good classification results distributed over the 
diagonal are greatly improved in relation to the previous case, formed by means of a 
less selective base, less suited to the configuration to which the module is applied. 

Adjustment of the database to the conditions of use thus allows, on the one hand, ^cT 
20 modi^ the structure of the network and, on the other hand, to optimize the 



generalization results obtained. 
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CLAIMS 

1) A method for forming a module^tended fog real-time simulation of -the flow 
mode, at any point of a pipe, of a multiphase fluid stream comprising at least a liquid 
phase and at least a gas phase, ^ that it is besi^ suited t^^ced operating conditions 
concerning^a^eiteHi mamhr^r nf determined stmcture parameters relative to the pipe, and 
a set of determined physical quantities, with fixed variation ranges for ss^ parameters 
and.«etd physical quantities, by^eans oya modelling system based on non-linear neural 
hetwork^^ving^ch inputs for^^iicture parameters and^hysical quantities, outputs 
where quantities necessary for estimation of the flow mode are available, and at .least 
one intermediate layer,|^e neural networks being determine^iteratively so-as to adjust 
to th e values of a learning base withmedeterniined tables connecting ^isffi&m values 
obtained for ^Jt^^" output dat^to tfa& corresponding values of |Ke input data^ chafafeterized (r 

- in tha t^^ eaming base s uited to the , impose* operating conditions Jis formed/ and 
no ptimiged ^neural networks|bes^ adjusting to the imposed operating conditions ^e 
generate^ 

2) A method as claimed in claim 1, [characterized in thatjthe^t of^physical 
quantities ^nsist^^^ydrodynamic quantities. 

3) A method as claimed in claim 1, Characterized in that the set of] physical 
quantitiesKonsists of Jthermodynamic quantities. 

4) A method as claimed inlaiay one of the previous) claiin;^, j^haracterized in that, 
saidjmodule^eing integrated in a general, bothj hydrodynamic and thermodynamic 



a^^neral, ^botnj 
-safd model i^ois 



multiphase flow simulation model, -satd model j^oised to form the learning base ^o^ to 
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select the -set-ef physical quantities t hat is best suited to the model, ^ well as the^ 
variation ranges fixed for parameters and physical quantities, and {M^ 
optimized neural networks best suited to the learning base^rmed are generate*^ 
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INSTITUT FRANCAIS DU PETROLE 

METHOD FOR FORMING AN OPTIMIZED NEURAL NETWORK MODULE 
INTENDED TO SIMULATE THE FLOW MODE OF A MULTIPHASE 

FLUID STREAM 

Inventors : Isabelle REY-FABRET, Emmanuel DURET, Eric HEINTZE 

and Veronique HENRIOT 

ABSTRACT 

^Method for forming a module (hydrodynamic or thermodynamic for example) 
■ intended for real-time simulation of the flow mode, at any point of a pipe, of a 
multiphase fluid stream comprising at least a liquid phase and at least a gas phas^so 
that it is best suited to fixed operating conditions concerning a certain number of 
determined structure and physical parameters relative to the pipe, and a set of 
determined physical quantities (hydrodynamic or thermodynamic quantities for 
example), with fixed variation ranges for the parameters and the physical quantities?) 

ft comprises using a modelling system based on non-linear neural networks baring 

each^jnp^s for structure parameters and physical quantities, outputs where quantities 
necessary for estimation of the flow mode are available, and at least one intermediate 
layer. The neural networks are determined iteratively to adjust to the values of a 
learning base with predetermined tables connecting various values obtained for the 
output data to the corresponding values of the input data. A learning base suited to the 
imposed operating conditions is used and optimized neural networks best adjusted to the 
imposed operating conditions are generated. 

Applications : modelling of hydrocarbon flows in pipes for exan^le!^ 



